Web Survey Bibliography
Online survey methods and online access panels are commonly used in both academic and private industry research. However, many industry reviews indicate the presence of fraudulent and inattentive online panel participants who pose a threat to data validity, with estimates of 8–25 percent of the sample being impacted. Although these challenges are not unique to online surveying, the nature of online panels may offer possibilities to improve data quality through real-time filters, rather than in data analysis. In this study, we retain all panel respondents passing and failing common web-survey quarantining methods to directly analyze filtering results on data quality. Through a choice experiment, we build a mathematical model to measure respondent irrationality through the classic strong axiom of revealed preference (SARP), which serves as the primary data-quality metric to test the efficacy of quarantining methods. We show that inattentive respondents failing “trap” or “red herring” questions, as well as fraudulent respondents heavily selecting low-probability screening questions, have significantly lower data quality compared to passing respondents. Removing failing respondents significantly improves data quality when filters are strategically executed. We also simulate the data-quality benefits of real-time filtering techniques during web-data collection. We conclude by advocating the use of low-probability filters as qualifiers, as well as strategic placement of trap questions just before the most crucial sections of a survey.
Web survey bibliography (4086)
- The art of asking survey questions; 2015; Grady, S., Johnson, S.
- Response Rates, Nonresponse Bias, and Data Quality: Results from a National Survey of Senior Healthcare...; 2015; Meterko, M.; Restuccia, J. D.; Stolzmann, K.; Mohr, D.; Brennan, C. W.; Glasgow, J.; Kaboli, P.
- An Introduction to Survey Research; 2015; Cowles, E. L.; Nelson, E.
- Suggestions for international research using electronic surveys; 2015; e Silva, S. C.; Duarte, P.
- Tailored fieldwork design to increase representative household survey response: an experiment in the...; 2015; Luiten, A.; Schouten, B.
- SSI Defines the Successful Mobile Survey Experience at ESOMAR; 2015
- Validity of Internet-Based Longitudinal Study Data: The Elephant in the Virtual Room; 2015; Pugh, C. A.; Summers, K. M.; Bronsvoort, M. C.; Handel, I. G.; Clements, D. N.
- Effects of Forced Responses and Question Display Styles on Web Survey Response Rates; 2015; Tangmanee, C.; Niruttinanon, P.
- Using virtual presence and survey instructions to minimize careless responding on Internet-based surveys...; 2015; Ward, M. K.; Pond III, S. B.
- Mixed-method feasibility study comparing the outpatient assessment of burn patients using a tablet device...; 2015; Mitchell, S. S.
- HUFFPOLLSTER: Pollsters Debate If Modern Surveys Can Be Trusted; 2015; Blumenthal, M.; Edwards-Levy, A.; Velencia, J.
- Using Internet to Recruit Immigrants with Language and Culture Barriers for Tobacco and Alcohol Use...; 2015; Carlini, B. H.; Safioti, L.; Rue, T. C.; Miles, L.
- An Updated Protocol to Detect Invalid Entries in an Online Survey of Men Who Have Sex with Men (MSM):...; 2015; A.; Konstan, J. A.; Iantaffi, A.; Wilkerson, J. M.; Galos, D; Rosser, B. R. S.Grey, J. A.
- Online Recruitment Methods for Web-Based and Mobile Health Studies: A Review of the Literature; 2015; Lane, T. S.; Armin, J.; Gordon, Ju. S.
- iTunes Song-Gifting is a Low-Cost, Efficient Recruitment Tool to Engage High-Risk MSM in Internet Research...; 2015; Holland, C. M.; Ritchie, N. D.; Du Bois, S. N.
- Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies...; 2015; Bartneck, C.; Duenser, A.; Moltchanova, E.; Zawieska, K.
- Challenges with Online Research for Couples and Families: Evaluating Nonrespondents and the Differential...; 2015; Busby, D. M.; Yoshida, Ke.
- A Note on the Use of Survey Research Firms to Enable Empirical Data Collection; 2015; Schoenherr, T.; Ellram, L. M.; Tate, W. L.
- Ethical issues in online research; 2015; James, N.; Busher, H.
- Circumventing Nonresponse - Upgrading Traditional Company Survey Data with Unobtrusive Data from Company...; 2015; Rasmussen, K. B.Thimm, H.
- Recruiting Online: Lessons From a Longitudinal Survey of Contraception and Pregnancy Intentions of Young...; 2015; Harris, M. L.; Loxton, D.; Wigginton, B.; Lucke, J. C.
- Calendar Instruments in Retrospective Web Surveys; 2015; Glasner, T.; van der Vaart, W.; Dijkstra, W.
- Gamification in market research: Increasing enjoyment, participant engagement and richness of data,...; 2015; Bailey, P.; Pritchard, G.; Kernohan, H.
- Survey Informatics: The Future of Survey Methodology and Survey Statistics Training in the Academy?; 2015; McCutcheon, A. L.
- Recruiting Respondents for a Mobile Phone Panel: The Impact of Recruitment Question Wording on Cooperation...; 2015; Busse, B.; Fuchs, M.
- Recruiting for addiction research via Facebook; 2015; Thornton, L. K.; Harris, K.; Baker, A.; Johnson, M.; Kay-Lambkin, F. J.
- Respondent Screening and Revealed Preference Axioms: Testing Quarantining Methods for Enhanced Data...; 2015; Jones, M. S.; House, L. A.; Zhifeng, G.
- Can a non-probabilistic online panel achieve question quality similar to that of the European Social...; 2015; Revilla, M.; Saris, W. E.; Loewe, G.; Ochoa, C.
- Exploring the Effects of Removing "Too Fast" Responses and Respondents from Web Surveys; 2015; Greszki, R.; Meyer, M.; Schoen, H.
- Response Rates for Patient-Reported Outcomes Using Web-Based Versus Paper Questionnaires: Comparison...; 2015; Horevoorts, N. J.; Vissers, P. A. J.; Mols, F.; Thong, M. S. Y.; van de Poll-Franse, L. V.
- Mode Effects in Mixed-Mode Economic Surveys: Insights from a Randomized Experiment; 2015; Hsu, J. W.; McFall, B. H.
- The effect of multiple reminders on response patterns in a Danish health survey; 2015; Christensen, A. I.; Ekholm, O.; Kristensen, P. L.; Larsen, F. B.; Vinding, A. L.; Gluemer, C.; Juel,...
- Innovative Recruitment Using Online Networks: Lessons Learned From an Online Study of Alcohol and Other...; 2015; Bauermeister, J. A.; Zimmerman, M. A.; Johns, M. M.; Glowacki, P. F.; Stoddard, S. A.; Volz, E. M.
- The best times to call in a mobile phone survey; 2015; Vicente, P.
- Yes-no answers versus check-all in self-administered modes ; 2015; Callegaro, M.; Henderson, V.; Murakami, M.; Tepman, Z.
- Validating self-reported mobile phone use in adults using a newly developed smartphone application; 2015; Goedhart, G., Kromhout, H., Wiart, J., Vermeulen, R.
- Use of Internet panels to conduct surveys; 2015; Kapteyn, A.; Liu, H., D.Hays, R. D.
- The quality of responses to grid questions as used in Web questionnaires (compared with paper questionnaires...; 2015; Dominguez, J. A.; de Rada, V. D.
- Going Online with a Face-to-Face Household Panel: Effects of a Mixed Mode Design on Item and Unit Non...; 2015; Burton, J.; Jaeckle, A.; Lynn, P.
- The comparison of mobile devices to computers for web-based assessments; 2015; Huff, K. C.
- Face-to-Face or Sequential Mixed-Mode Surveys Among Non-Western Minorities in the Netherlands: The Effect...; 2015; Kappelhof, J.
- The Influence of the Answer Box Size on Item Nonresponse to Open-Ended Questions in a Web Survey ; 2015; Zuell, C.; Menold, N.; Koerber, S.
- What are the Links in a Web Survey Among Response Time, Quality, and Auto-Evaluation of the Efforts...; 2015; Revilla, M.; Ochoa, C.
- Comparing a Cell Phone Survey and a Web Survey of University Students ; 2015; Couper, M. P.; Kim, S.; Woo, Y.
- Impact of mixed modes on measurement errors and estimates of change in panel data; 2015; Cernat, A.
- Identifying predictors of survey mode preference; 2015; Millar, M. M.; Olson, K.; Smyth, J. D.
- Tips for Creating Web Surveys for Completion on a Mobile Device; 2015; McGeeney, K.
- Probabilistic Web Survey Methodology in Education Centers: An Example in Spanish Schools; 2015; Tapia, J. A., Menendez, J. A.
- Understanding Participation in a Web-Based Measurement Burst Design: Response Metrics and Predictors...; 2015; Griffin, J., Patrick, M. E.
- Rating Scales in Survey Research: Using the Rasch model to illustrate the middle category measurement...; 2015; Bradley, K. D., Peabody, M. R., Akers, K. S., Knutson, N. M.